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ABSTRACT 

Max-min fuzzy relational system can be regarded as a network of max 
and min operational elements. Thus the inverse problem of fuzzy relational 
equation is interpreted as an input estimation problem from output values in 
the corresponding network. An approximate network model of fuzzy relational 
system is proposed. An algorithm of obtaining an approximate solution of the 
system is presented by using a neural network technique. The availability is dis- 
cussed with a numerical experiment. 
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Introduction 

Inverse problem of fuzzy relational equation (Fuzzy Inverse Problem) was proposed by 
E.Sanchez in 1976[1]. The solution of fuzzy inverse problem was shown by Tukamoto et al m 
1977[2], And now, it is used for diagnosis of complicated systems. 

Max-min fuzzy relational system can be regarded as a network which consists of max and 
min operational elements. Thus the fuzzy inverse problem is interpreted as an input value esti- 
mation problem from output values in the corresponding network. 

In this view point, input of network can be identified when output and the network struc- 
ture are given. Assuming the network of fuzzy relational system can be approximately con- 
structed by the perceptron, we can regard the input of fuzzy system as the input of perceptron 
when output and the perceptron structure are given. 

In this paper, an input value estimation algorithm based on perceptron model is pro- 
posed and it is applied to solving the fuzzy inverse problem. Numerical experiment is done to 
investigate the availability of this method, and the result of experiments is discussed. 


Input Estimation Algorithm of Perceptron Model 

Perceptron neural network model[3] is used in this paper. It is summarized as follows; 

a. Output value of j -th neuron in the k -th layer is denoted by 

«;• 

b. Threshold value of j -th neuron in the k -th layer is denoted by 

0 / • 

c. Connection coefficient from the i -th neuron in (k-1) th layer to j -th one in k -th 
layer is denoted by 
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d. The relation of above three values are described by (l)-(3). 

«/=/(*/) 

i 

1 +exp(-s) 

Input estimation algorithm of perceptron model is described as follows. 
Preparation 

[1] Assume the perceptron model has n -input items and m -output items. 

[2] Define the evaluation function as 

£(s)=|£{y,-«j(s)} 2 

where s= [yi,J2, J 3. ■ ■ • sj and y y is the y-th output value of the perceptron. 
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Algorithm 

[1] Set the initial input s as an arbitrary value. 

[2] Calculate output 


[3] 


u= 


u 1 ,u 2 ,u 3 , ■ ■ ■ 


for the current input value s. 

Change the value s according to 

d s_ dE 
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where e is a positive value. 

[4] Repeat [2]-[3] until the value E attains a sufficiently small value. 

[5] Final value s is the estimated value by the perceptron. 


(5) 


Fuzzy Inverse Problem 

Fuzzy relation R between set X and set Y is regarded as a fuzzy set on the direct product 
of X and Y , and its membership function is denoted by 

\l R Jfxy={(x,y)ljteX,yGn (6). 

Assume that A is a fuzzy set on X and B is another fuzzy set on Y , where these 
membership functions are p i . and respectively, then fuzzy relation R satisfies (7) which 
means (8). 

B = R o A (7) 

p B (y)=max ieX {p« (j:,y)Ap A (x)} (8) 

If A and B are fuzzy input and output, respectively, then (7) is interpreted as an equa- 
tion of the system which has fuzzy input and output. 



Then the fuzzy inverse problem is the inverse problem of fuzzy relational equation, i. e. 
identifying A for the given B and R in the equation (7). 

Method of Solving Fuzzy Inverse Problem by using Perceptron Model 

This method is divided into two phases , i. e. the learning phase and the solving phase. 
The learning phase is summarized as follows; 

[1] Let A. and B. be the i -th input and output of fuzzy relation system R ( i = 1,2, ... 
M ) , respectively. 

[2] Encode A. and B. to x ( and y, .respectively, according to 

[0,l]3fl,-l-« i =2.2xa i -l.le[-l.I,I.l] ( 9 ) 

[0,1 ]36, l-»y,=0.8x bi+ O.le [0.1 ,0.9] ( 10) . 

[3] Let multi layer perceptron be learned by using input-output pair x ( and y, obtained 
at [2], 

After finishing this learning phase, we can get the solution as follows, 

[4] Let B be a fuzzy set to be solved in the fuzzy inverse problem. 

[5] Encode B to y by using eq. (10). 

[6] Apply the input estimation algorithm to the learned perceptron and estimate the 
input for given output y. 

[7] Decode y to A by using eq. (9), then we can get the solution of the problem. 


Numerical Experiment 

To investigate the availability of the method discussed in the previous section, a numeri-. 
cal experiment on a digital computer has been done as follows; 

[1] Fuzzy relation, i. e. the solution in the fuzzy inverse problem, is given as (11) in this 


experiment. 

Hr (*i.yi) HR(*2.:yi) 
Hr(* 1J2) Hr(* 2J2) 
R = tiR(xi,y 3 ) IIrUiJs) 
HrUiOU) HrO^OU) 
Hr (Ji.ys) Hr (* 2 .;y 5) 


Hr (*5.:yi) 
Hr Us.) 1 2) 
Hr Us.ya) 
Hr 

Hr Us^s). 


0.6 0.5 0.8 0.3 0.2 

0.4 0.1 0.9 0.6 0.4 

0.1 0.1 0.9 0.8 0.5 

0.9 0.2 0.9 0.1 0.5 

0.4 0.5 0.3 0.8 0.9 . 


( 11 ) 


[ 2 ] 


The learning data for the perceptron is generated as follows; 

i) Make fuzzy sets A, - A m6 whose membership values at each element take all com- 
bination of values {0, 0.2, 0.4, 0.6, 0.8, 1.0} (c.f. 6 s = 7776). 

ii) Operate each A . to the fuzzy relation R by using max-min composition, then we 
can get the fuzzy set B. 

iii) Encode fuzzy sets A. and B. by eqs’ (9) and (10), then we will obtain the learning 
data x ( and y ( . 

Let’s move to the learning phase by using and y t as leaning data. The structure of per- 
ceptron used in this experiment is shown as in table 1. 


tabl e 1 : Outline of the Perceptron 
layer number 1 2 3 4 

number of neurons 5 10 10 | 5 

Error back propagation algorithm [4] is used for learning. Counting the learning process is 
defined as follows : one learning process is a learning operation for a paired input-output 
data. The perceptron used in this experiment learns about 500 thousand times. The distri- 
bution of evaluation function (4) value for learning data is shown in figure 1. 
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[4] The test-data in the fuzzy inverse problem is made as follows; 

i) Make fuzzy sets A. whose membership values at each element are random values 
from [0,1] (where 1 = 1 - 1000 in this experiment). Get B. by compositing A. to 
the fuzzy relation R. 

[5] Encode B- by eq. (10), and get y,. Applying input estimation algorithm to the percep- 
tron, we can get estimated input value x*j. Then we get the solution of fuzzy inverse 
problem by decoding x*j to A*, by eq. (9). 

[6] Composite the obtained solution A*, to fuzzy relation R , and we get B*. The correct- 
ness of solution is considered as the closeness of membership value by each element 
between B*. and B. 

I l 

[7] Distribution of the values of evaluation functions (12) -(14) For all test-data are shown in 
figure 2 - figure 4 . 


E mta n = Z\b* r b,\ 

(12) 

E mn =Max \b* r bj 1 

(13) 

E miD =Min\b* r bj\ 

(14) 

for all j , b t eB l b*,eB* L 



Discussion 

The availability of using perceptron for fuzzy inverse problem was shown trough a 
numerical experiment in previous chapter. The approximate solution of the fuzzy inverse prob- 
lem is obtained , but its precision is not enough. This is mainly because that the error of 
approximation of fuzzy relation by perceptron is not small enough. 

Distribution of approximation error of fuzzy relation was shown in figure 1 in the previ- 
ous chapter, but the inputs for error measuring are the same one as learning inputs, precisely. 
It is necessary to measure the error for no learning inputs. So the distribution of evaluation 
function (4) for no learning inputs is shown in figure 5 . By comparing error in learning and no 
learning cases, it should be noted that the distributions have the same shape. It depends on the 
generalization factor of neural networks. Hence it could be considered that the differences 
between learning and no learning are independent with the precision of solution. 

The distribution of figure 1 and figure 5 are bell shaped but not exponential This is con- 
sidered that the approximation error is not less than a certain threshold value. This is because a 
confliction occurs between one learning input-output pair and others. Therefore, if we can 
increase the learning times or use more input-output pairs for learning, the improvement of 
precision for approximating fuzzy relation is not expected. 

Now let’s discuss how small the approximation error of fuzzy relation is. The measure- 
ment was done as follows; Let change membership value of fuzzy set A at one element in the 
interval [0,1], and compare the membership value of fuzzy set B obtained by compositing 
fuzzy relation R in eq. (11) and another one obtained from the output of perceptron. The 
membership values used for comparison are shown in table -2 and the results are shown in 
figure 6 - figure 10. In these figures, the horizontal axis represents membership value of a vari- 
able element of fuzzy set A , and vertical axes represent membership values of each element of 
fuzzy set B. There exist two lines in these graphs, where one (which has linear shape) 
represents the characteristics of approximated fuzzy relation, another (which has not linear 
shape) indicates the characteristic of perceptron which approximates the fuzzy relation. 
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table 2 : Conditions of membership value for fuzzy set A 

No. 

element number 

figure number 

1 

2 

3 

4 

5 

1 

[0,1] 

0.3 

0.5 

0.2 

0.7 

fig-6 

2 

0.3 

[0,1] 

0.2 

0.6 

0.4 

fig-7 

3 

0.2 

0.6 

[0,1] 

0.4 

0.7 

fig-8 

4 

0.8 

0.7 

0.2 

[0,1] 

0.5 

fig-9 

5 

0.2 

0.9 

0.3 

0.4 

[0,1] 

fig.io 


Conclusion 

Input estimation algorithm of perceplron model has been proposed and applied to the 
fuzzy inverse problem. Numerical experiments have been done in order to get the solution of 
fuzzy inverse problem. The precision of approximate solution obtained by this method is dis- 
cussed, and the approximation error distribution is investigated. From the results of these 
numerical experiments, it is concluded that this method is available to obtain the approximate 
solution of fuzzy inverse problem. 
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Table 1. Outline of the Perceptron 


Outline of the Perceptron 

layer number 

1 

2 

3 

4 

number of neurons 

5 

10 

10 

5 


Table 2. Conditions of membership value for fuzzy set A 


Conditions of membership value for fuzzy set A 

No. 

element number 

figure number 

i 

2 

3 

4 

5 

1 

■UUB 

0.3 

0.5 

0.2 

0.7 

fig-6 

2 

■ 

[0,1] 

0.2 

0.6 

0.4 

fig. 7 

3 

0.2 

0.6 

[0,1] 

0.4 


fig- 8 

4 

0.8 

0.7 

0.2 

[0,1] 

0.5 

fig.9 

5 

0.2 

0.9 

0.3 

0.4 

[0,1] 
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Figure 3. Distribution of evaluation function for maximum evaluation 
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Figure 6. Comparison of fuzzy set B and output of perceptron (No.l) 
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Figure 7. Comparison of fuzzy set B and output of perceptron (No.2) 
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Figure 8. Comparison of fuzzy set B and output of perceptron (No.3) 


195 


1.0 



Figure 9. Comparison of fuzzy set B and output of perceptron (No.4) 
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Figure 10. Comparison of fuzzy set B and output of perceptron (No.5) 
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